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Abstract 

We study the Classical Probability analogue of the dilations of a quantum dynamical semi- 
group in Quantum Probability. Given a (not necessarily homogeneous) Markov chain in 
discrete time in a finite state space E, we introduce a second system, an environment, and a 
deterministic invertible time-homogeneous global evolution of the system E with this envi- 
ronment such that the original Markov evolution of E can be realized by a proper choice of 
the initial random state of the environment. We also compare this dilations with the dila- 
tions of a quantum dynamical semigroup in Quantum Probability: given a classical Markov 
semigroup, we show that it can be extended to a quantum dynamical semigroup for which we 
can find a quantum dilation to a group of ^-automorphisms admitting an invariant abelian 
subalgebra where this quantum dilation gives just our classical dilation. 

AMS Subject Classification: 60J10, 81S25. 

1 Introduction 

We study the analogue in Classical Probability of the dilations in Quantum Probability of a 
quantum dynamical semigroup (QDS) in discrete time. A QDS T* describes the evolution of a 
quantum system, possibly open, but "Markovian" , and homogeneous in time. A dilation of T* by 
a quantum stochastic flow jt allows to represent it by the conditional expectation of a quantum 
Markov process, analogously to the representation of a classical Markov semigroup (CMS) by 
a classical Markov process. Anyway, such a dilation in Quantum Probability enjoys a reacher 
structure which allows to dilate the semigroup T* at the same time also by a unitary group 

thus showing that the system evolution T* and the flow jt do not contradict the axioms of 
Quantum Mechanics, i.e. that they can arise from a unitary time-homogeneous evolution [/* of 
an isolated bigger system, consisting of the given system and its environment [4,6,7,9-11]. 

The first aim of this paper is to introduce similar dilations in Classical Probability, choosing 
a self-contained approach in a completely classical framework. These classical dilations are 
interesting, not only to better understand the relationship between the two probabilistic theories, 
but also from a simply classical point of view, to better understand the relationship between 
Markov processes and deterministic invertible homogeneous dynamics. 
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The second aim of the paper is to show, by appropriate embeddings, that such dilations in 
Classical Probability are really analogous to the quantum dilations which inspire them. Even if 
in Classical Probability we shall obtain some extra property which has no analogue in Quantum 
Probability. 

Wc consider here discrete time Markov evolutions in a finite state space. A well known 
theorem due to Birkhoff shows that any doubly stochastic matrix is a convex combination of 
permutation matrices. These describe with matrix terminology one-step evolutions which are 
both deterministic and invertible. Analogously, a theorem due to A. S. Davis [3] shows that any 
stochastic matrix, doubly stochastic or not, is a convex combination of deterministic matrices. 
These describe with matrix terminology one-step evolutions which are deterministic but not 
necessarily invertible. As a consequence, A. S. Davis shows that each finite state Markov chain 
can be realized as an automaton with random inputs, thus establishing a connection between 
Markov chains and automata theory. That is, using a different terminology, that each finite 
state Markov chain can be realized via an innovation process. 

The relationship between Markov chains and deterministic dynamics can be further analyzed 
investigating if Markov evolutions can be realized as deterministic invertible homogeneous evo- 
lutions of the system coupled with a second system. The existence of such representations is 
theoretically relevant if Markov chains are applied to phenomena, like physical phenomena for 
example, for which an underlaying theory postulates deterministic invertible homogeneous evo- 
lutions in absence of noise and external disturbances. For these phenomena the second system 
introduced by the dilation models the surrounding world, the environment, the source of the 
noise, which is given now a dynamical explanation. Of course, here the characterizing property 
is not simply that the global evolution is deterministic as in innovation theory, but that it is 
also invertible and homogeneous in time. 

More precisely, we consider a system with finite state space E, undergoing a discrete time 
evolution given by a Markov chain, not necessarily homogeneous. Then, we introduce an en- 
vironment with its state space {T,G), a measurable space, together with an invertible one-step 
global evolution Q;:£^xr^£^xr. Thus, if (i, 7) is the state of the compound system at 
time 0, then a*(i,7) is its state at time t EN, where hence a* gives a deterministic invertible 
homogeneous global evolution. Nevertheless, if the environment state is never observed and if 
initially it is randomly distributed with some law Q on (F, Q), then the evolution of the observed 
system turns out to be stochastic and, if F, G, a and Q are properly built, it is given by the 
original Markov chain. In this case, we say that (F, Q, a, Q) is a dilation of the Markov evolution 
in E. 

Actually in this paper, given only the state space E (arbitrary but finite), we build a universal 
dilation (F, ^, a, {Q}), where {Q} is an entire family of distributions which can produce any 
Markov chain in E: every Markov chain, homogeneous or not, can be dilated by taking always the 
same model (F, a) for the environment and the global evolution, and by choosing every time 
the proper distribution Q for the initial state of the environment. Moreover, our construction, 
which relays on A. S. Davis decomposition of stochastic matrices, allows to interpret each Markov 
chain, not only as the stochastic dynamics resulting from the coupling with an environment, but 
at the same time also as an automaton with random inputs, which are now dynamically provided 
by the environment itself. 

An unpublished result by Kiimmerer [6] provides a dilation of a homogeneous Markov chain 
with a construction similar to ours, but he looks for faithful environment states and he finds an 
interaction a which depends on the chain under consideration. Therefore his construction does 
not exhibit that universality which allows us to dilate also non-homogeneous Markov chains. Our 
aim is similar also to the aim of Lewis and Maassen [8] when they consider classical mechanics in 
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continuous time and, taken a linear Hamiltonian system modelling a particle and its environment, 
they describe how Gibbs states of the whole system lead to stationary Gaussian stochastic 
processes for the observables pertaining to the particle under consideration. However, we do 
not look for good global states, but for good states Q of the environment alone which lead to 
Markov evolutions of the system E, our particle, for every independent choice of its initial state. 

The paper also proves that our dilations (F, Q, a, Q) are restrictions of quantum dilations: 
every CMS in E admits an extension to a QDS for which we can find a quantum dilation which is 
itself an extension of the dilation of the CMS. However, we shall not embed the whole universal 
dilation {T,Q,a,{Q}) in the quantum world, as quantum dilations do not exhibit the same 
universality and they strictly depend on the QDS under consideration, so that it is not enough 
to change the environment state to get another QDS. 

In the sequel, given a complex function / on a domain E, we shall denote with the same 
symbol / also its extension on a domain ExT, f{i, 7) = f{i). Similarly, given a map (p : E ^ E, 
we shall denote with the same symbol also its extension, by tensorizing with the identity, on 
a domain E xF to E xF, = 

2 Preliminaries 

We consider a system with finite state space E = {1, . . . , N} and power cr-algebra £, fixed for 
the whole paper. 

Markov evolution. We denote by P = {Pij)ijeE a stochastic matrix on E, so that Pij > 
and Pij = 1 for every i, and we identify the elements of the complex abelian *-algebra £°°(<S), 
the system random variables f : E ^ C, with the column vectors in C^, so that every stochastic 
matrix P in E defines an operator in C°°{£), 

(P/)(z) = ^P,,/(j), 

describing a one-step probabilistic evolution. Taken a sequence of stochastic matrices {P{t))t>o, 
P(0) = 1, the evolution of a system random variable / from time to time t > is therefore 
given by 

f^p{i)...p{t)f, v/G/:-(f). (1) 

We call it Markov evolution and, in the following, we shall denote a sequence {P{t))t>o simply 
by {P}- If the sequence is constant, P{t) = P for every t, then the evolution is homogeneous 
and it is described by the CMS (P*)t>o in jC°°{S). 

Decompositions of stochastic matrices. We denote by D a deterministic matrix in E, 
that is a stochastic matrix with a 1 in each row. Every D describes with matrix terminology a 
deterministic evolution (3, where 

= {Dij)i,jeE, P : E ^ E, Dij = (2) 

so that Df = f o p. The invertible (bijective) maps in E correspond to the special cases of 
permutation matrices. The deterministic matrices are just the extreme points of the convex set 
of stochastic matrices and every P is a convex combination of deterministic matrices, 

P = J2peDe, pe>0, ^P€ = 1. (3) 
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One can find such a decomposition with terms, with the set L labehing all possible de- 
terministic matrices and weighing each with pi = -Pi/3^(i) • • • Pni3i{N)- Let us remark that 
decomposition ([3]) is not unique and that, for any given P, no more than A^^ — + 1 terms 
are needed [3]. Anyway, since we are not going to fix P, we shall employ ([3|) in the described 
form: a convex combination of all the deterministic matrices which can produce any P simply 
by changing the weights {pe)eeL- 

The Markov chain. For every Markov evolution {P}, there exists a Markov chain 
(il,^, {J^t)t>o, iXt)t>o, (IPfc)fcG_E) with transition probabilities given by P{t), i.e. a discrete time 
stochastic process of random variables Xt : 0, ^ E, adapted to a filtration {J^t)t>o, and a family 
of probability measures P^, k £ E, such that the starting distribution of the process depends on 
k, Xq has Dirac distribution 5^ under P^, but the process always enjoys the Markov property 
with transition matrices P{t): 

Fk{Xt+i = j\J^t) = Fk{Xt+i = j\Xt) = P{t + l)x,j, yk,j eE,t>0. 

Thus, a system random variable / € C°°{£) has now a stochastic evolution given by the *-unital 
homomorphism 

jt:C^{£)^C^{Tt), :=/(Xt), t > 0, (4) 

and the Markov evolution ([1]) admits the representation 

(P(l) • • • P{t) /) (k) = Kk [f{Xt)] , V/ G £°°(f ). (5) 

Markov chains and automata. Let us briefly show a possible realization of the Markov 
chain by means of the decomposition ([3]). If P(t) = J2e£LPii't) then one can take 

n = ExL^, ij = {i,{iri)nen), 
Xo{io)=i, Xt{iv)=p,,o...op,^{i), Yt{oj)=£t, ten, 

= a{Xo) a{Yn; n G N), J't = ct(Xo, Y^; l<s< t), (6) 

Pfc = 4® ((g)p(i))- 

teN 

In this way the Markov chain associated to {P} is represented as an automaton with independent 
random inputs: 

Xt = (3Yt{Xt-i), 

so that at every step the set of all possible mappings (3i : E ^ E \s available and the system 
evolution is determined by the value of the input parameter i which is selected randomly accord- 
ing to p{t) and independently of the previous steps. If the sequence P{t) is constant, then the 
Markov chain is homogeneous and the input parameters can be chosen identically distributed. 
To get a dilation, we shall introduce a bigger il, namely E x G^, with a G bigger than L in order 
to define an invertible one-shot coupling 0, and with Z instead of N in order to get a dynamics 
a* with group properties. 
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3 Dilations and universal dilations 



Dilation of a Markov evolution. We call dilation of the Markov evolution {P} in /1°°{£) a 
term 

{J^t)t>o, {Zt)t>o, (IPfe)fcG£;) 

such that 

• every Zf = {Xt,Tt) is a random variable in {^,J^) with values in {E x r,£ Q), being 
(T,Q) a fixed measurable space, 

• the term (il,^, {J^t)t>o, iXt)t>o, {^k)keE) is a Markov chain with transition matrices {P}, 

• the random variable (^O; '""o) has distribution 5k® Q under P^, being Q a fixed distribution 
on Q, 

• there exists an invertible bimeasurable map a:ExT^ExT such that Zt = a*{ZQ) for 
every t > 0. 

Thus, besides the system E, a second system is introduced, an environment with state space 
(r,^). Their states Xt and Tt are asked to be random variables on a same measurable space 
(fi, J^) such that the global state Zt = (Xt, Tt) undergoes a deterministic invertible homogeneous 
evolution a*. Therefore all the Xt and are determined by Zq, so that Xt and T^ are measurable 
with respect to <t(Zo) = (t(Xo,To) ^ and, depending on the probability chosen on T, they 
are deterministic if and only if Zq is. Nevertheless, a probability typically fixes only the value 
of Xq. The space is also endowed with a filtration J^f Note that only the Xt are asked 

to be adapted to J^t so that, in particular, Tq does not have to be .Fo-measurable. Therefore the 
Xt are not trivially .T-Q-measurable, even if their values are completely determined by the values 
of Xq and Tq, and, neglecting the environment, each {J^t)t>o, {Xt)t>o,^k) can be a non 

trivial stochastic process. What we ask is that {J^t)t>o, {^t)t>o,^k) actually is a Markov 

chain starting from k with transition matrices {P}- At the same time however, this Markov 
chain is compatible with a deterministic, invertible and homogeneous model for the evolution 
of E coupled with an environment T. In particular, as Xq = k, the whole stochasticity of the 
process is due only to the randomness of the unobserved initial state Tq of the environment. 

A dilation gives another interpretation of every evolution ([1]), compatible with ([5]): 

(P(l) • • • P{t) /) (k) = Ek [fiXt)] = Ek [f{Zt)] = Ek [f{a\k, To))] , V/ G ). 

Indeed, the stochastic evolution ([!]) of a system variable / G C°°{£) is now described by the 
*-unital homomorphism 

jt : C^iS) - C^^iJ't), f ^ jt[f] ■■= f{Xt) = fiZt) = f o a\Zo), (7) 

which is injective as a* is invertible. And now we could also consider global random variables 
F : E X r ^ C and their evolution F ^ F{Zt) = Fo a\Zo). 

Universal dilation. Let us denote by V the set of sequences of stochastic matrices {P} in E. 
We call universal dilation of the Markov evolutions in C°°{£) a term 

{J^t)t>Q, {Zt)t>o, (^k,{P})keE,{P}eV 
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such that every (0,,J^,(J^t)t>o,{Zt)t>oA^k,{P})keE) is a dilation of the corresponding Markov 
evolution {P}. We call universal such a dilation because we ask that the same ^l, J^, J-'t and 
Zt allow to represent all the Markov evolutions in £.°°{£), with the change of the probabilities 
^k,{P} alone. Therefore, both the environment state space {T,Q) and the global evolution a 
depend only on the state space E, not on the particular Markov evolution to be dilated. 



Standard dilation and standard universal dilation. In order to show that every state 
space E admits a universal dilation, now we consider a particular class of dilations and of 
universal dilations. Let us describe all the special requirements we are interested in for the 
dilation of a Markov evolution {P}. 

First of all we want the sample space Q, to be just ExF, the state space of the global system. 
As we want it to describe all the possible initial global states, we ask the random variable Zq 
to be the identity function and Xq and Yq to be the coordinate variables: if cj = (?',7), then 
Zo{uj) = uj, Xo{uj) = i and To(c^) = 7. Thus, for ah t > 0, = {Xt, Tt) = a* o Zq = Zq o a\ 
Xt = Xq o a* and = Tq o a* . 

We are interested in an environment F = = X Gn with Gn = G finite set. In this case 
the environment state 7 G F has infinitely many components Qn G G„, n £ 7^, and we introduce 
also the coordinate variables Yn{uj) = Qn, the random n-th components of the environment. 
Then, endowed G with its power a-algebra, we want all the functions so far introduced to be 
measurable and so we ask Q to be the natural cr-algebra Q = (t(To) = (7(1^; n G Z) on F, and 
J- to he £ <^ Q = (t(Xo,To) on Jl. Supposing that at time only Xq is observed and that at 
each following instant t only the information carried by is acquired, we want the filtration 
J^o = (t{Xo), Tt = a{Xo, Ys; l<s< t), for t > 1. 

In order to get consistence between these definitions and the global evolution a, we ask that 
each Yf is involved in the interaction with the system only once, between time t — 1 and time t. 
More precisely, first we ask an invertible map 

(f):ExG^ExG, (8) 

denoted by (t){i,g) = [(f)^{i,g),(jP{i,g)), giving the one-step coupling between the system and a 
single environment component. Secondly, we introduce the left shift 

: F ^ F, (i?n)neZ G T, C/„ G Gn ^ (5n+l)neZ G r, Qn+l e Gn- 

Then, denoted by 0i the map (f) m E xGi, extended (pi and 1? in by tensorizing with identities, 
we ask 

a = •& o ^i. 

Roughly speaking, when a. is applied for the first time between time and time 1, the map 0i 
couples the system state Xq with Yi, giving the new system state Xi = Xq o a = Xq o cpi = 
(^^{Xq, Yi), and then the shift -d prepares Y2 for the following interaction with Xi. So the state of 
the system at a positive time t is Xt = Xq o a'^ = (f)^{Xt-i,Yt), which is automatically adapted 
to Tt- Thus •& could be interpreted as a free evolution of the environment. If we explicitly 
introduce also the random variables Y^*^ = o a*, the n-th environment components at time 
t > 1, then 

y(t) =Y oa' = l ^"+^''' if n 7^ 0, ^ f y„+t, if n < -t, n > 1, 

"^(Xt-i,Y-/*-'^), ifn = 0, yG{Xt-i+n,Yn+t), if-i + l<n<0, 

andXt = cj>^iXt_i,Yl'-'^] 
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At long last, we consider the probabilities P^. Of course, they have to be factorized as 5k® Q 
on = £ Q. We also require Q to be factorized as Qq ® ( (S'neN ^C'^)) cr-algebra 
a{Yn] n < 0) (8) ct(1^; n > 1), so that {Yn)n<o ~ Qo while ~ q{n) for every n > 1 and they 
are all independent. This guarantees the Markov property for the process Xt with respect to J-t 
with transition probabilities 

P{t)ij = E %(^) ^^'J ^E,t>l, (9) 

so that the only point is to check if the transition probabilities Q are the desired ones. 

A dilation like this will be called standard in the following. Summarizing, a dilation is 
standard if 

• r = = X„g2 Gn, Gn = G finite set with power cr-algebra, Q = cylindric cr-algebra, 

• 0. = E xT, io = (i,^) = {i, {gn)n&) G f^, E, 7 G T, 5„ G G, 

• Xq{lj) =i, To = (l"„)„gZ, Yn{uj) = Qn, To{uj) = 7, Zo{uj) = LO, 

• = £00 = a{Xo)®a{Yn; n<O)0(T{Yn; n>l), J^t = (7{Xo,Ys; I < s < t), t>0, 

• Pfc = 5fc ® Qo ( {8>neN Q{n)) , 

• a = "& o (pi^ with an invertible = (p : E x Gi ~^ E x Gi, and with the left shift on T. 
Then, for every t > 1 we have 

. Zt = a'oZo = Zooa' = iXt,Tt), 
. Tt = Tooa* = (yi*))„ez, 

A standard dilation is therefore specified by the term (^G, 0, Qo ® ( (8)nGN • 

With a standard dilation the evolution of every global random variable is described by the 
group of *-automorphisms J*, t £ Z, where 

J : £°°(.F) ^ £°°(.F), J{F)=Foa. 

Note that a standard dilation always allows to see every Markov chain also as an automa- 
ton with independent random inputs Yf, which now are provided by the environment via the 
dynamics a. Given a standard dilation (^G,(j),Qo (0nGN ^ CMS P*, the random 

inputs Yt can always be chosen independent and identically distributed by taking q = q{l) and 
replacing Qo ® ( (8>nGN ^("')) with q"^^. 

A universal dilation will be called standard if it is given by a family of standard dilations 
(G, </>, Qjp}) , {P} £ V, all of them with the same G and (p. Thus we fix the model for the 
environment and for the global evolution with G and (p, and then we require the existence of a 
family of initial distributions Q^py for the environment state, each one giving rise to a different 
Markov evolution for the system. A standard universal dilation is therefore specified by the 
term (G, (p, (Q{p}){p}g-p) • A standard universal dilation is not uniquely determined by the state 
space E, but it always exists. 
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Theorem 1. For every finite state space E, there exists a standard universal dilation 
{GjCp, (Q{p}){p}G-p) of the Markov evolutions in C°°{£-). 

Proof. We only have to exhibit a proper set G, together with the couphng (f) and the probabihty 
measures Q[p^ on Q. 

Given £^ = {1, . . . , and the set L labelhng the all possible maps P : E ^ E, we set 

G = ExL, i,j,keE, i€L, g = {j,e)eG. 

Arbitrarily fixed j = 1, we focus on points (1,^) in G. Thus, taken two points (z, (1,-^)) ^ 
(i', (1,^')) in X G, we get {Pe{i), {i,i)) 7^ {l3(:i{i'), and so we can find an invertible map 

[ ■■■ , if J / 1- 

We choose an arbitrary (p satisfying (|1U|) . 

Given {P}, we fix a decomposition Q for every P{t), thus obtaining the distributions p{t) 
on L; for every distribution p{t) on L we define on G = E x L the distribution 

q{t) = 6i0p{t). 

Thus P{t)ij = ^'^Pe{t) S/3i(i)j = ^ 1g{^) ^4>B(i^g)^j for every t G N. Chosen an arbitrary distri- 

bution Qq on <T(y„; n < 0), if we define Q^py = Qq'^ { 0teN '/(O); then every stochastic process 
{il,J^,{J^t)t>o,iXt)t>o,0^k,{P})keE) is a Markov chain with transition matrices {P}, indepen- 
dently of Qo and of the definition of <j)[i,{j,i)) for j ^ 1. Therefore (G, 0, ((5{p}){p}g-p) is a 
standard universal dilation of the Markov evolutions in C°°{£). □ 



In this construction, even if each g £ G has two components, g = {j,t), the probability is 
always concentrated only on those g of the kind g = (1,^), but we need the first component j 
to define an invertible (j). Analogously, we are considering the evolution only for positive times 
so that all the components g-n, n < 0, are never involved in the interaction with the system, but 
they are needed to define an invertible shift t?. 

Since the decomposition ^ is not unique, just as the choice of Qo; we could find other 
probabilities P on ^ inducing the same Markov evolutions for the system. On the other hand, 
considering non-factorized Q or even non-factorized P, we would obtain new stochastic processes 
{^t)t>o, i^t)t>o,^), without any Markov property guaranteed, which now would depend 
on the definition of (j) for J 7^ 1- 

Let us remark also that, just because of the universality of the construction, a dilation 
(G, Qjp}) is usually non minimal for a particular evolution {P}. 

The cocycle approach to standard dilations. Given a Markov evolution {P} with a stan- 
dard dilation (G, (j),Qo'^{ ^teN '/(O)) i where G, (j), q{t) can be defined as in the proof of Theorem 
[T] or not, as long as we consider only system random variables neglecting the environment, we 
can avoid the shift "d and define a deterministic, invertible, but inhomogeneous global evolution 
(ft which never involves the environment components gn for n < 0, but which generates the same 
Markov chain and the same Markov evolution for the system. Consider indeed the invertible 
maps in 0, 

:= o</)i oi?*-!, ipt := (pt o ■ ■ ■ o (j)-^ = 'd-^ o a\ t > 1, 
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where (t)t actually acts only in x Gt, where it is just the coupling ([TO]) , while ipt actually acts 
only in £J X Gi X • • • X Gj. Then, set (pQ = Id, we get Xt = Xq o = Xq o ipt for every t > 0. 
Because of the group properties of and a*, the evolution ipt satisfies the cocycle property 



'Pt+s 



{}~^ o ip, o o (ft, yt,s>i, 



and, of course, its knowledge is equivalent to the knowledge of a*. 

In particular the *-unital injective homomorphism d?]) can be written as 

f^jt[f]:=fiXt)=foipt, t>0. (11) 

If we denote by IEg[/ o 0] the system random variable in C^{£) defined by « i— > / o g), then 
the stochastic evolution (jlip satisfies 

jo[/] = /(Xo), jt[f] = jt-i [^<^if ° ^]] kYt=9)^ V/ e t > 1, (12) 

where Eg[/ o (^] are ^t-adapted processes, while the random variables /(y^^^), indicators of 

the events (Yj = g), are the increments of the J^i-adapted processes Nf = X]s=i I{Ys=g)^ t > 0. 
Hence Eq. (fT2|) can be read as a stochastic equation with respect to the noises Nf . 

We can even reduce the sample space from E x to E x G^, restrict here Tt and 
Pfc) and define (/jf in x G^ by ([8]) and (I12p . Anyway, thanks to the cocycle properties of 
(^t, it is always possible to introduce later X„<oG„ and the shift in order to recover the 
whole environment state space (G^, Q\ the evolution a and the initial environment distribution 
Qo ® (0teN s° th-o!^ the two constructions are equivalent and can be considered different 
descriptions of the same situation. 

Choosing the cocycle approach, a standard dilation of a Markov evolution {P} is a Markov 
chain ($7, J^, (J^t)t>o, (Xi)t>o, (IP'fc,{P})fces), where 

= X G^, W = (i, (5r„)„gN), 

Xo(c^) = i, Yt{.^)=gu Xt = <f{Xt^x.Yt). teN, 
.F = a(Xo)0a(yt; t GN), .F* = a(Xo, n, 1 < s < t), (13) 

Pfc = 4«>((8)g(t)). 

This chain is specified by the term (G, <\)^ ®t<m 

Let us underline that the Markov chain ()13|) is similar to ([6]) , as also this one is an automaton 
with independent random inputs. Nevertheless, the invertibility of ^ endows this chain with a 
reacher structure because it implicitly introduces also the deterministic invertible homogeneous 
evolution a*. 



4 Dilations of classical Markov semigroups and of quantum dy- 
namical semigroups 

We want to compare a standard dilation with the dilation of a QDS in Quantum Probability. 

Given a Hilbert space "H, always complex separable in the paper, let us denote its vectors 
by /i, or using Dirac's notation, so that {h'\h) denotes the scalar product (linear in h) and 
\h'){h\ denotes the operator h" ^ {h\h")h'. Let B{TC) be the complex *-algebra of bounded 
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operators in 7i. Given a Hilbert space -L^(/i), with a probability measure ji on some measurable 
space, and given a measurable complex function / on the same measurable space, let mj denote 
the multiplication operator 

vfif : Dom(mj) L'^{fi), Dom(mj) = {/i G L^ifJ-) ■ fh G L^(/i)}, ruf h = fh, 

which is bounded if and only if / G L°°{jx). Let P(L^(/i)) be the abelian complex *-algebra of 
bounded multiplication operators in L?'{^). Given a finite space S with its power cj-algebra 5, 
let /i5 denote the uniform probability on {S,S) and let {\i)}i^s denote the canonical basis of 
LP'{^s)- Moreover, let us denote C°°{S) = L°°{fj.s) also by C°°{S). Given two Hilbert spaces 
Ti. and /C and a trace operator r in /C, let : B{TC) B{1C) — > B(Ti.) denote the conditional 
expectation with respect to r. Given a vector k G /C, let us denote the conditional expectation 
with respect to simply by E«;. In the sequel, given a bounded operator a in TC, we shall 

identify it with its extension a (81 1^ inTi IC. 

Quantum extension of a CMS. A discrete-time QDS in B(7i) is a semigroup (T*)t>o with 
T : B(Ti.) Biji) stochastic map, that is a linear, bounded, completely positive, normal and 
identity preserving operator. 

In order to extend a CMS in C°°{£) by a QDS in some BiTi), we take 7i = L?'{^e) and we 
embed C'^{£) in BiTL) by the *-isomorphism / 1-^ mj between C^{£) and ViTL). 

We say that a QDS T* in B{n) extends a CMS P* in C°^{£) if 

Tm/ = mpj, V/ G £°°(f). 

Such extension always exists. For example, given a stochastic matrix P, using a representation 
([3]) and notations (l2|), P is extended by the stochastic map 

Ta = Y,p,\i)m{)\a\(3S))(il e B{n). (14) 

Note that this extension T* maps B(TC) to T>{7i) in only one step. The extension of a CMS is 
not unique at all: for example every permutation P can be extended also by a *-automorphism 
Ta = u* au, provided that, for every j in E, u \j) = P* \ j) up to a phase factor (necessary and 
sufficient condition). 

QP-dilation of a QDS. Given a QDS T* in B{Tl), a typical Quantum Probability construc- 
tion employs a Hilbert space 3, a unitary operator 1/ in 7^ ® 3 and a unit vector v in 3, to dilate 
T* at the same time by a quantum stochastic flow and by a group of *-automorphisms. 
Taken infinitely many copies 3ri of 3, the quantum stochastic flow 

t 

3t:B{n)^B{n)®B[<^^r), t>0, 

n=l 

is the solution of the quantum stochastic equation 

jo = IdB(w), 3t{a) = Y.jt-i{^\z)(z'\[V* ■a(^l^-V])(E)\z'){z\, t > 1, 

2:2:' 

where {|z)} is a given basis in 3- 
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Denoted by K, the infinite tensor product <S>ne'i 3n with respect to the stabihzing sequence 
of unit vectors ^jJn = v, denoted by @ the left shift operator in /C, denoted by Vi the operator V 
in 7^ (g) 3i, extended in W (g) /C every operator, consider the unitary operator in TC JC 

u = evi. 

The group of *-automorphisms is J*, t G Z, where 

J : B{n) ® B{IC) B{n) B{IC), J{A) = U*AU. 

Then J* (a) = jt{a) for every a € B{n) and t > 0. 

A term (3, V, v) defines a QP-dilation of the QDS T* in B{n) if 

r*a = E„®t [jt{a)] = E„»z [J* (a)] , Va G ^(W), t > 0. (15) 

The equahties hold for f > if they hold for t = 1, that is if Ta = E„ [V* a V] for all a in B{n). 

Given 3, the spatial tensor product <S>n£Z^i'^n) is a C*-algebra which can be naturally 
embedded in B{IC) for every stabilizing sequence ^pn used in the definition of fC. Given V and 
V, the C*-algebra B{H) (^nez-^CSn)) ^ B{H)^B{K.) is invariant for J. Indeed, denoted by 
<d the right shift in 0„g^;B(3n)) the restriction of J gives 

J:S(W)0((g)e(3„)) ^^(W)® ((g)m3„)), J{A) = V^Q{A)Vr, (16) 

which is a *-automorphism, is independent of v, and generates a group J* satisfying (llSp with 
y& pyj.g g^j^j locally normal state. Thus, at the C*-algebras level, a QP-dilation (3, V^,f) of T* 
consists of a C*-algebra ®n&^{'^n) depending on 3, of a quantum stochastic flow jt and of a 
group of *-automorphisms J* depending on y, and of a pure locally normal state v®'^ depending 
on V, such that representations (llSp hold. 

Quantum extension of a standard dilation. Given a stochastic matrix P va. E and a 
standard dilation (G, g®^) of the CMS P\ we show that P* can be extended to a QDS T* for 
which we can find a QP-dilation which is itself an extension of (G, 0, gr®^) . This shows that a 
standard dilation is a classical analogue of a QP-dilation. 

The first step to study this relationship is to embed the standard dilation (G, (f)^ g®^) in the 
quantum world. In order to get this embedding at the Hilbert space level, we should introduce 
a proper measure on {G^^Q). Taken on E, the proper measure on [G^^Q) should give a 
product measure on {E x Q) invariant for the deterministic invertible evolutions a, "d, 

01. Thus the natural choice would be the probability measure Nevertheless, it would be 

singular with respect to the initial environment distribution g®^, so that this latter could not 
be obtained from a state in L^(//g^). Therefore now we work at C*-algebras level. 

We embed in the quantum world the spatial tensor product of G*-algebras 

£^ = £°°(£:)®((g)£°^(G„)). 

ngZ 

It is the sub G*-algebra of C°°{J-) which consists of all continuous functions in the compact set 
E X G^, and it is invariant for o0x, o?? and oa. 
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Taken again Ti. — L'^I^^e), we introduce the sequence of Hilbert spaces 3n — 
the algebras of multiplication operators I'(3n)) and the spatial tensor product 

which is an abelian sub C*-algebra of B{l-L) ( (S^nez -^On) 

We embed £^ in B{T-L) (0neZ'^(3n)) by the *-isomorphism F i— > mp between and 
Vz defined by mapping each F belonging to 

t 

:= ) ( (g) , t G N, 



n=~t 



5(2i+l) 



to the multiplication operator mp belonging to 'D{H)<^^\^(S>n=-t ^(3n) j = T^i^L {fXE'^fJ'G 
abelian subalgebra of B{n) ( {g)^-* 'S(3n)) = ^(^.^(/.e ^ ;ug^^*+^^)). 

The invertible map (p in E x G defines the unitary operator m 7i ^ = L"^ {^e ® /^g) 

V = Y,\(t>{i,g)){i,gl (17) 

SSG 

which is a quantum extension of the deterministic invertible evolution <j) as 

V*mFV = mFod>, VF e C'^iE)<g)C'^{G). 
With respect to the canonical basis of 3, we have V = J2g,g'eG ^gg' ® \9){9'\ with 

ygg'= E \i){h9\<t>{j.9')){j\. 

According to Section 3, in the following let denote the expectation of a random variable 
on (E X G'^,£ Q) with respect to the probability measure Sk q^^. 

Theorem 2. Let P* be a classical Markov semigroup in a finite state space E and let {G, (f>, q®"^) 
he a standard dilation. Let Ti = L'^{ple), l^t 3 = L'^{plg), let V he the unitary operator (|17p in 
W ®3, an-d let J he the *- automorphism ([T6|) in B{Tl) ( 0nez '^(3n)) • Then 

(1) for every glohal random variable F belonging to , it holds 

Jimp) = ruFoa] (18) 

(2) taken v = Y.g(iGy/%\9) ^ 3, 

— for every k £ E, every Fi, . . . , F„ G and every hounded and continuous function 
ri-.C^ ^ C, it holds 

E,[r?(Fi, . . . ,F„)] = tr [r?(mf,, . . . ,mpj \k){k\ ® , (19) 

— (3,^, f) is a QP-dilation of the quantum dynamical semigroup T*, 

^«=E(E^/^^;<;')"(E ^/VV')' (20) 

gdG g'€G g"£G 

which extends the classical Markov semigroup P*. 
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Proof. (1) For every F belonging to an algebra ^j, 



■■oo 

-1 ■ 



5(2t+l)^ 



SO that, by continuity, Eq. ([TH]) is proved for all F £ 

(2) For every t G N, the pure locally normal state Iv"^^) {v^'^\ restricted to ^n=_t B{3n) gives 
the state 1 1>® (2^+1) ) (^y^W) | , where the unit vector i;® (2t+i) belongs to <S>i=-t = (fJ-c 
and has |t;®(2*+i)|2 = dg®(2t+i)/^^®(2t+i)^ r^^^^ 

Ek[F] = tr [mp ■ \k){k\ (g> \v^^){v^^\ 

for all F £ ^'^tt] ^^'^ hence, by continuity, for all F £ C^. Then Eq. (fTn|) is proved, as 
r]{Fi, . . . , Fn) belongs to whenever Fi, . . . , F„ G and r] is bounded and continuous. 
Moreover, for every a G BiTL), 

My*^y]= E \3'){3'\'^{v\V*aV\j")®\v){j"\ 

= E l/)^/^(i'>5'l^*ay|/,/)Vg7(/l= E Vw\j'){<t>{3\9')\am",g")){f\ 



E Ka' ^ ^99" = Ta. 

9,9',9"&G 



Then 



Tmf = Y,qg\i){<P^{i,g)\mf\^^{i,g)){i\=mpf, V/ G 



gea 



□ 



Equation (fT8|) shows that the group of *-automorphisms J* defined by (3, V) is a quantum 
extension of the deterministic invertible homogeneous evolution a* defined by {G,(l)). Then, 
automatically, also the quantum stochastic flow jt extends the classical jt- Moreover, Equation 
(fT9]l shows that the whole standard dilation {G,cl),q^'^) of P* is extended by the QP-dilation 
(3, V, v) of T* as the states q^^ and of the environments, together with the dynamics oa and 
J, give rise to the same joint distribution for the trajectories of the global random variables F 
belonging to and for the trajectories of the corresponding normal operators mp belonging to 

B{Tl) ;B(3n)) • This happens for every possible starting state k of the classical Markov 

system and for the corresponding state \k){k\ of its quantum counterpart. 
Let us note also that if {G, (/>, g*^^) is built as in Theorem [H then 

and the stochastic map (f20l) becomes just the stochastic map ([Till . 
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